Bridging Bayesian and Minimax Mean Square Error Estimation via Wasserstein Distributionally Robust Optimization
نویسندگان
چکیده
We introduce a distributionally robust minimium mean square error estimation model with Wasserstein ambiguity set to recover an unknown signal from noisy observation. The proposed can be viewed as zero-sum game between statistician choosing estimator—that is, measurable function of the observation—and fictitious adversary prior—that pair and noise distributions ranging over independent balls—with goal minimize maximize expected squared error, respectively. show that, if balls are centered at normal distributions, then admits Nash equilibrium, by which players’ optimal strategies given affine estimator prior, further prove that this equilibrium computed solving tractable convex program. Finally, we develop Frank–Wolfe algorithm solve program orders magnitude faster than state-of-the-art general-purpose solvers. enjoys linear convergence rate its direction-finding subproblems solved in quasi-closed form. Funding: This research was supported Swiss National Science Foundation [Grants BSCGI0_ 157733 51NF40_180545], Early Postdoc.Mobility Fellowship [Grant P2ELP2_195149], European Research Council TRUST-949796].
منابع مشابه
Distributionally Robust Stochastic Optimization with Wasserstein Distance
Distributionally robust stochastic optimization (DRSO) is a robust approach to stochastic optimization problems in which the underlying distribution is not known exactly. It seeks a decision which hedges against the worst-case distribution in an ambiguity set, containing a family of distributions relevant to the considered problem. Unfortunately, the worst-case distributions resulting from many...
متن کاملWasserstein distance and the distributionally robust TSP
Recent research on the robust and stochastic travelling salesman problem and the vehicle routing problem has seen many different approaches for describing the region of ambiguity, such as taking convex combinations of observed demand vectors or imposing constraints on the moments of the spatial demand distribution. One approach that has been used outside the transportation sector is the use of ...
متن کاملQuantitative Stability Analysis for Minimax Distributionally Robust Risk Optimization
This paper considers distributionally robust formulations of a two stage stochastic programming problem with the objective of minimizing a distortion risk of the minimal cost incurred at the second stage. We carry out stability analysis by looking into variations of the ambiguity set under the Wasserstein metric, decision spaces at both stages and the support set of the random variables. In the...
متن کاملOptimization of Generalized Mean-Square Error in Noisy Linear Estimation
A class of least squares problems that arises in linear Bayesian estimation is analyzed. The data vector y is given by the model y = P(Hθ + η) +w, where H is a known matrix, while θ, η, and w are uncorrelated random vectors. The goal is to obtain the best estimate for θ from the measured data. Applications of this estimation problem arise in multisensor data fusion problems and in wireless comm...
متن کاملRate-distortion function via minimum mean square error estimation
We derive a simple general parametric representation of the rate–distortion function of a memoryless source, where both the rate and the distortion are given by integrals whose integrands include the minimum mean square error (MMSE) of the distortion ∆ = d(X, Y ) based on the source symbol X , with respect to a certain joint distribution of these two random variables. At first glance, these rel...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Mathematics of Operations Research
سال: 2023
ISSN: ['0364-765X', '1526-5471']
DOI: https://doi.org/10.1287/moor.2021.1176